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ABSTRACT 


It  is  mandatory  for  tank  commanders  and  gunners  to  train  in  the  Advanced 
Gunnery  Training  System  (AGTS),  but  the  effectiveness  of  conducting  this 
training  is  unclear.  Although  anecdotal  evidence  suggests  that  training  transfer 
may  be  occurring,  previous  research  could  not  definitively  prove  that  training 
transfer  is  occurring  between  the  simulator  and  the  performance  during  live  fire 
gunnery  qualification.  The  purpose  of  this  study  was  to  assess  whether  there  was 
a  correlation  between  performance  in  the  AGTS  and  modified  live  fire  gunnery. 
Sixty-five  participants  from  the  Army  Armor  School  volunteered  for  this  study. 
Data  was  collected  on  their  AGTS  and  live  fire  performance.  Results  indicated 
there  was  no  significant  correlation  between  performance  in  the  AGTS  and  on 
the  modified  live  fire  gunnery.  Exploratory  analyses  showed  those  who  had 
completed  the  AGTS  Gate  to  Live  Fire  performed  better  on  the  modified  live  fire 
gunnery  than  those  who  had  not  completed  the  AGTS  training.  This  result 
suggests  that  training  transfer  may  be  occurring.  Given  that  specific  metrics  are 
identified  and  incorporated  into  the  AGTS,  there  is  strong  potential  for  simulation 
training  to  allow  individuals  to  attain  a  higher  level  of  proficiency  than  would  be 
attained  by  just  live  training. 
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I.  INTRODUCTION  AND  BACKGROUND 


This  thesis  explores  the  performance  of  an  individual  in  a  tank  simulator 
and  their  subsequent  performance  conducting  similar  engagements  during 
modified  live-fire  gunnery.  Past  studies  have  shown  there  was  no  correlation 
between  the  performance  in  the  simulator  and  the  performance  during  live-fire 
gunnery.  Past  studies  have  provided  anecdotal  evidence  though  that  simulators 
do  provide  training  value. 

A.  MOTIVATION  AND  PROBLEM  STATEMENT 

In  2003,  I  attended  the  Armor  Officer  Basic  Course  where  I  went  through 
training  on  the  M1A1  Abrams  Integrated  Management  (AIM)  tank.  This  is  a 
predecessor  to  the  current  variant,  the  M1A2  System  Enhancement  Program 
(SEP)  Version  2  tank.  I  was  trained  in  a  simulator,  the  Unit  Conduct  of  Fire 
Trainer  (UCOFT),  and  when  complete  executed  a  live-fire  familiarization  on  the 
actual  tank.  This  consisted  of  a  series  of  engagements,  both  day  and  night  that 
demonstrated  to  the  student  the  capabilities  of  the  tank.  I  fired  the  tank  in  the 
gunner  and  tank  commander’s  positions.  I  conducted  training  in  the  course  that 
taught  me  how  to  maneuver,  conduct  maintenance,  and  other  courses  that  an 
armor  officer  needs,  but  this  was  the  only  training  I  was  to  receive  on  actually 
firing  the  tank  before  being  assigned  as  a  platoon  leader  of  a  tank  platoon  that 
was  already  deployed  in  support  of  Cperation  Iraqi  Freedom.  If  it  was  not  for  the 
training  I  received  in  the  basic  course,  I  would  have  had  no  experience  on  the 
tank,  as  I  tried  to  lead  my  platoon  in  combat  operations.  I  credit  my  platoon 
sergeant,  a  gifted  tanker  and  good  friend,  and  the  rest  of  my  platoon  with  the 
success  we  had  in  Iraq,  but  the  training  I  received  helped  ensure  I  was  prepared 
to  execute  my  job  as  a  platoon  leader.  This  experience  has  motivated  me  to 
investigate  training  methodologies  and  systems  and  how  those  are  used  to  train 
Soldiers  to  execute  their  real-world  missions.  The  research  conducted 
investigated  whether  there  is  a  correlation  between  the  results  captured  in 
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simulator  usage  and  the  results  of  those  same  individuals  as  they  execute  the 
same  tasks  in  a  live-fire  event. 

Prior  to  executing  the  live-fire  qualification,  the  armor  community  currently 
requires  all  tank  crews  to  use  a  simulator,  Advanced  Gunnery  Training  System 
(AGTS),  which  is  similar  to  the  UCOFT.  This  simulator  allows  the  tank 
commander  and  gunner  to  practice  in  a  highly  accurate  replica  of  the  actual  tank 
commander  and  gunner  stations  inside  the  tank  turret.  Although  simulator  usage 
is  required,  the  United  States  Army’s  doctrinal  purpose  for  executing  the 
simulator  training  is  “to  ensure  the  crew  possesses  the  skills  and  experience 
necessary  to  safely  execute  live-fire  gunnery”  (“Heavy  Brigade  Combat  Team 
[HBCT]  Gunnery,”  2009,  p.12-6). 

Safe  operation  of  the  tank  is  more  than  just  the  tank  commander  and 
gunner  being  able  to  coordinate  fire  commands  inside  the  turret  during  an 
engagement.  The  safe  operation  involves  all  of  the  crew  members  of  the  vehicle 
executing  their  individual  tasks  to  a  high  level  of  proficiency.  These  tasks  can 
range  from  normal  operational  level  maintenance  to  the  ballet  of  live-fire.  Every 
crew  member  has  a  set  of  important  tasks  they  must  accomplish  before  the 
gunner  can  even  pull  the  triggers  and  send  a  round  towards  a  target.  The 
identification  of  all  of  these  tasks  is  critical  to  ensure  the  United  States  Army 
maintains  highly  trained  and  proficient  tank  crews,  especially  with  the  increasing 
impact  felt  by  declining  budgets. 

Safety  is  imperative  in  operating  an  armor  vehicle;  however,  the  simulator 
can  provide  more  than  just  those  skills  required  for  safe  operation.  Due  to  the 
cost  in  conducting  live-fire  and  today’s  fiscally  austere  environment,  it  is 
imperative  to  exploit  all  of  AGTS  capabilities  to  more  provide  more  effective 
training.  A  tank  is  an  expensive  system  to  maintain  and  operate.  Between  the 
cost  of  maintenance,  fuel,  and  ammunition,  it  becomes  quickly  apparent  that  tank 
units  must  determine  what  tasks  can  only  be  trained  and  certified  during  live 
training  and  what  training  can  be  taught  using  other  less  costly  methods, 

including  virtual,  gaming,  and  potentially  constructive  approaches. 
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The  ACTS  simulator  has  the  capability  to  train  specific  individual  and 
collective  tasks  that  transfer  to  live  execution  of  those  same  tasks.  We  must 
identify  which  tasks  when  successfully  completed  in  an  ACTS;  indicate  a  level  of 
proficiency  that  will  transfer  to  success  on  the  battlefield  and  those  tasks  which 
are  required  to  be  completed  in  a  live  tank  on  a  training  range  to  produce 
success  in  war.  For  example,  the  command  could  focus  live  training  on  more 
difficult  individual,  crew,  and  collective  tasks  if  the  crews  have  met  an  identified 
level  of  proficiency  on  more  basic  tasks  through  other  means,  such  as  simulation. 
Doing  so  would  reduce  the  time  spent  in  live  training,  which  results  in  resource 
savings,  or  allow  the  live  training  to  focus  on  tasks  which  can  only  be  trained  live, 
resulting  in  a  better  trained  force  at  the  same  cost. 

Once  these  tasks  are  identified  and  metrics  developed  to  place  a  value  on 
the  level  of  training  accomplished,  commanders  can  then  ensure  crews  receive 
training  based  upon  the  crews’  needs,  and  not  the  end  criteria  of  simply 
completing  a  certain  exercise  in  the  simulator.  The  purpose  of  this  thesis  was  to 
address  the  gap  in  knowledge  regarding  which  tasks  and  metrics  in  the  ACTS 
best  transfer  to  live-fire. 

B.  RESEARCH  QUESTIONS  AND  CORRESPONDING  HYPOTHESIS 

Is  there  a  correlation  between  the  crew  score  during  the  Gate  to  Live-fire 
(GTLF)  exercise  utilizing  the  Advanced  Gunnery  Training  System  and  Table  6 
modified  live-fire  gunnery  qualification? 

Ho  (Null  hypothesis):  There  is  no  correlation  between  the  tank  commander 
and  gunner  score  from  the  GTLF  utilizing  the  AGTS  and  the  score  of  the  Table  6 
modified  live-fire  gunnery. 

Ha  (Alternative  hypothesis):  There  is  a  correlation  between  the  tank 
commander  and  gunner  score  from  the  GTLF  utilizing  the  AGTS  and  the  score  of 
the  Table  6  modified  live-fire  gunnery. 
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Exploratory:  Is  there  a  significant  statistical  difference  between  those  who 
completed  all  of  their  ACTS  level  exercises  and  those  that  did  not  on  the  Table  6 
modified  live-fire  gunnery? 

C.  SCOPE  AND  OVERVIEW 

This  thesis  limited  the  tasks  investigated  to  those  captured  by  both  the 
ACTS  and  during  the  live-fire  on  the  crew  score  sheet.  These  tasks  are  fire 
commands,  crew  engagement  times,  hit  or  miss,  and  overall  score  for  an 
engagement.  By  limiting  the  results  of  the  identified  tasks,  an  observational  study 
was  conducted  that  evaluated  current  practices  in  the  armor  community  without 
introducing  new  metrics.  The  study  also  contained  a  survey  to  understand  the 
demographics  of  the  participants  along  with  their  perceptions  on  the  training 
effectiveness  of  the  ACTS  in  relationship  to  the  live-fire  gunnery. 

D.  LITERATURE  REVIEW  OF  RELEVANT  STUDIES 

The  studies  referenced  in  this  literature  review  were  conducted  by  the 
U.S.  Army  Research  Institute  for  Behavioral  and  Social  Sciences  between  the 
years  of  1987  and  1994  (Black  &  Graham,  1987;  Campshure  &  Drucker,  1990; 
Hagman,  1994;  Hughes,  Butler,  Sterling,  &  Berglund,  1987;  Kraemer  &  Rowatt, 
1993;  Smith  &  Hagman,  1992;  Smith  &  Hagman,  1994).  Notably,  no  studies 
since  1994  have  addressed  the  question  as  to  whether  simulation  training  is 
correlated  with  live-fire  performance.  Thus,  no  studies  have  been  conducted  on 
the  current  simulation  system,  AGTS,  an  important  omission  as  the  AGTS  is  a 
more  sophisticated  and  realistic  simulator  than  was  used  in  the  1980s  and  90s. 

These  studies  were  of  two  types,  those  that  quantitatively  assessed 
training  transfer  from  simulator  to  live-fire,  and  those  that  focused  on  the  culture 
of  using  simulation  training. 

1.  Studies  that  Assessed  Training  Transfer 

Of  most  relevance  to  the  current  study,  three  studies  did  examine  training 
transfer  of  individual  tasks  from  simulator  training  to  live-fire,  in  particular,  reticle 

4 


aim  and  time  for  first  round  on  target  (Hughes  et  al.,  1987;  Campshure  & 
Drucker,  1990;  Smith  &  Hagman,  1994).  Reticle  aim  was  used  by  the  UCOFT’s 
computer  as  a  metric  to  determine  how  fast  the  crew  could  progress  through 
the  training  matrices.  In  both  the  Hughes  et  al.  (1987)  and  Campshure  &  Drucker 
(1990)  studies,  it  was  interesting  to  discover  that  the  majority  of  tank  crews 
(tank  commander  and  gunner)  had  not  competed  all  of  the  exercises  that  were 
described  as  necessary  prior  to  conducting  their  live-fire  gunnery  tables.  This 
was  due  to  insufficient  time  allocated  prior  to  the  live-fire  gunnery  and 
demonstrates  that  each  crew  is  different  in  how  fast  or  slow  they  can  progress  in 
the  training. 

Results  across  these  studies  consistently  showed  that  crews  that  had 
conducted  simulator  training  were  actually  able  to  detect  the  target  and  engage  it 
quicker  than  those  that  had  less  or  no  simulator  training.  This  time  difference  was 
noticed  during  the  initial  live-fire  tables,  but  the  difference  became  less  significant 
as  the  crews  progressed  through  the  live-fire  tables  to  the  point  that  when  the 
crews  shot  their  final  qualification  table,  there  was  no  appreciable  difference 
between  crews.  Of  interest  is  the  idea  that  if  training  in  the  simulator  actually 
benefited  crews  in  acquiring  targets  and  engaging  them  quicker,  it  is  possible 
that  the  tables  could  be  revised  to  start  crews  at  higher  levels  of  engagements. 
This  idea  requires  there  be  some  metric  that  captures  a  crew’s  proficiency  to 
ensure  in  fact  that  crews  could  start  at  a  higher  degree  of  difficulty. 

2.  Studies  Examining  the  Culture  of  Using  Simulation 

The  overall  take  away  from  the  literature  reviewed  was  that  the  simulator 
was  providing  valuable  training.  Seven  studies  reviewed  conducted  quantitative 
measures  on  crew  performance,  although  only  the  three  previously  mentioned 
studies  looked  at  training  transfer  between  simulator  and  live-fire.  Hughes  et  al. 
(1987)  and  Smith  &  Hagman  (1992)  went  one  step  further  and  used  qualitative 
measures  in  the  form  of  surveys  given  to  the  crews  to  gain  additional  insight  into 
simulator  usage.  These  surveys  asked  the  individuals  what  they  perceived  as  the 
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benefits  and  drawbacks  of  the  simulator  and  its  use  in  preparing  for  live-fire 
gunnery.  It  is  important  to  note  that  while  the  surveys  are  the  Soldiers’  opinions,  it 
is  the  “buy-in”  that  an  individual  has  that  the  system  is  working  that  gives  the 
system  its  value.  Command  and  crews  generally  felt  that  the  simulator 
contributed  to  their  training,  but  many  stated  it  should  not  be  considered  a 
replacement  to  live-fire  gunnery.  Complaints  ranged  from  not  realistic  enough  to 
that  “gut  feeling”  that  simulations  cannot  replace  the  real  thing.  The  largest 
positive  comment  was  the  feeling  that  the  simulator  would  be  a  good  tool  for 
crew  to  maintain  proficiency  once  they  had  qualified  during  live-fire  gunnery.  This 
acceptance  that  a  simulator  can  provide  the  valuable  training  necessary  to 
prepare  crews  ultimately  ensures  commanders  integrate  that  system  into  their 
training  plans. 

The  article  by  Blackwell  and  Brown  (1994)  discussed  that  certification  in 
the  UCOFT  is  necessary;  however,  it  failed  to  identify  from  the  command 
perspective  exactly  what  the  UCOFT  was  accomplishing  in  quantifiable  terms. 
The  general  consensus  seemed  to  be,  “We  know  it  is  making  our  crews  better, 
we  just  can’t  prove  it  to  you.” 

Crew  experience  was  another  theme  discussed  throughout  all  of  the 
studies.  Although  it  is  important  to  know  who  the  participants  of  the  study  are, 
crew  status  seems  to  be  a  more  important  variable  than  the  experience  level  of 
the  individual  tank  crew  members.  The  Army  realizes  that  crews  will  have 
turbulence  due  to  the  Army’s  individual  Soldier  assignment  system  that  keeps 
Soldiers  moving  every  three  to  four  years  between  duty  stations.  The  armor  and 
cavalry  community  also  understands  this  turbulence  with  the  designation  of 
crews  being  considered  in  either  a  new,  turbulent,  or  sustainment  status. 
Although  crews  were  identified  by  the  chain  of  command  during  the  gunnery 
process,  it  was  noted  that  the  new  or  turbulent  crews  generally  did  not  have 
enough  time  to  accomplish  all  of  the  simulator  training  required  (Hughes  et  al., 
1987).  Many  of  these  crews  completed  the  minimum  that  allowed  them  to 
conduct  the  live-fire  gunnery  (Hughes  et  al.,  1987).  This  lack  of  emphasis  on 
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simulator  training  demonstrates  that  while  individuals  generally  “felt”  the 
simulator  was  doing  something,  live  training  trumped  all  else  in  the  final 
determination.  It  would  be  interesting  to  see  if  the  culture  of  using  simulation  has 
changed  since  these  studies  were  conducted.  In  summary,  few  studies  have 
examined  training  transfer  from  simulator  to  live-fire  in  tank  crews.  The  attempt 
by  these  studies  to  address  the  training  transfer  of  tasks  from  the  UCOFT  to  live- 
fire  were  adequate  for  the  first  fielding  of  the  Abrams  tank  and  the  simulator  to 
support  the  training  of  the  tank  commander  and  gunner.  The  Abrams  tank  and 
the  simulator  have  gone  through  upgrades  as  new  technology  has  been 
developed  and  then  integrated  into  the  platforms.  The  Army’s  training  strategy  for 
tank  crews  has  also  changed  with  lessons  learned  from  being  at  war  for  ten 
years.  It  is  currently  unclear  due  to  the  20  years’  worth  of  changes,  the  increasing 
acceptance  of  simulation  usage  as  evidenced  in  the  Army  gunnery  training 
program  and  the  improvements  to  the  ACTS,  what  the  level  of  training  transfer  is 
from  the  ACTS  simulator  to  live-fire. 

E.  ARMY  GUNNERY  TRAINING  PROGRAM 

The  Army  has  developed  a  training  program  that  provides  commanders 
and  their  trainers  a  framework  from  which  to  build  their  training  program.  This 
framework  ensures  commanders  and  trainers  throughout  the  Army  are 
conducting  training  to  a  base  standard.  Having  this  base  standard  also  allows 
provides  commanders  and  trainers  with  the  flexibility  to  adapt  their  training 
programs  based  upon  their  current  location  and  mission  requirements. 

1.  Training  Methodoiogy 

The  United  States  Army  gunnery  training  program  consists  of  three 
different  phases,  individual,  crew,  and  collective  training.  The  Army  defines  these 
phases  as: 
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a.  Individual 

The  individual  gunnery  phase  trains  individual  crewman  on  crew  level 
skills,  using  classroom  and  home-station  training  in  conjunction  with  the  Gunnery 
Skills  Test  (GST). 

b.  Crew 

The  crew  gunnery  phase  develops  crew  skills  on  Tables  1,  2,  3,  4,  and  5 
and  culminates  in  crew  qualification  on  Table  6. 

c.  Collective 

The  collective  gunnery  phase  develops  section  and  platoon  coordination 
and  fire  control  and  distribution  on  Tables  7,  8,  10  and  11,  culminating  in  section 
and  platoon  qualifications  on  Tables  9  and  12.  There  are  also  guidelines  for 
executing  a  company-level  combined  arms  live-fire  exercise  (CALFEX)  with 
organic  indirect  fire  and  sustainment  unit  support.  (“Heavy  Brigade  Combat  Team 
[HBCT]  Gunnery,”  2009) 

This  delineation  into  three  phases  allows  for  tasks  trained  in  an  earlier 
phase  to  be  integrated  into  the  next  phase.  An  example  of  this  integration  is  fire 
commands.  Each  individual  in  the  crew  is  responsible  for  specific  fire  commands 
based  upon  the  type  of  target  the  crew  is  going  to  engage.  Along  with  the  fire 
command  is  a  series  of  specific  tasks  and  actions  that  the  crew  member 
accomplishes.  Each  crew  member  has  their  own  specific  responsibilities  that 
must  be  executed  simultaneously  for  the  crew  to  successfully  engage  a  target. 
Thus,  the  successful  engagement  of  the  target  requires  individual  crew  members 
to  be  proficient  in  their  individual  tasks,  the  crew  to  incorporate  those  individual 
tasks  into  crew  tasks  and  execute  those  crew  tasks,  and  finally  to  execute  the 
collective  section  and  platoon  tasks  with  multiple  tanks. 

During  individual  training,  there  are  multiple  techniques  of  training  each 
crew  member.  Loaders  do  not  have  a  simulator,  but  are  normally  trained  by  the 
gunner  in  the  actual  tank  using  dummy  rounds  that  are  the  same  dimensions  and 
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weight  of  the  live  round.  Drivers  do  not  have  a  specific  simulator  that  they  train  in 
for  gunnery,  but  do  execute  training  events  to  improve  their  driving  abilities 
throughout  the  training  cycle.  It  is  the  tank  commander  and  gunner  on  whom 
virtual  training  is  focused. 

Virtual  training  is  conducted  for  the  tank  commander  and  gunner  to 
develop  the  skills  necessary  to  engage  targets,  not  just  for  the  live-fire 
qualification,  but  for  combat  operations  also.  Simulators  are  used  to  allow  the 
tank  commander  and  gunner  to  engage  targets  multiple  times  without  incurring 
the  cost  that  comes  with  firing  live  ammunition.  The  Army  recognizes  that  tank 
crews  will  be  at  different  levels  of  proficiency,  and  has  three  broad  categories  for 
tank  crews.  The  virtual  training  that  is  conducted  for  the  tank  commander  and 
gunner  is  based  upon  which  of  three  categories  the  crew  is  placed. 

a.  New 

“Either  the  VC,  gunner,  or  both  are  new  to  their  position.”  (“Heavy  Brigade 
Combat  Team  [HBCT]  Gunnery,”  2009,  p.  12-5). 

b.  Turbulent 

“Both  the  VC  and  gunner  have  previously  held  the  position  they  are  in,  but 
have  not  worked  together  as  a  crew.”  (“Heavy  Brigade  Combat  Team  [HBCT] 
Gunnery,”  2009,  p.  12-5). 

c.  Sustainment 

“The  VC  and  gunner  have  previously  qualified  together  as  a  crew.” 
(“Heavy  Brigade  Combat  Team  [HBCT]  Gunnery,”  2009,  p.  12-5). 

Once  the  proficiency  of  the  crew  is  determined,  a  training  program  can  be 
developed  for  that  tank  commander  and  gunner  to  prepare  them  for  the  live-fire 
gunnery  qualification. 


9 


2.  Army  Armor  Gunnery  Tables 

The  Army  conducts  a  series  of  live-fire  tables  in  which  the  main  goal  is  to 
ensure  a  crew  is  proficient  on  the  tank.  The  culminating  table  for  an  individual 
crew  is  the  Table  6,  Crew  Qualification.  Commanders,  with  the  master  gunners 
and  staff,  have  latitude  in  exactly  what  engagements  his  crews  will  execute. 
The  primary  requirement  is  that  the  commander  must  develop  his  tables  to  meet 
the  Minimum  Proficiency  Levels  (MPLs)  as  outlined  in  the  Heavy  Brigade 
Combat  Team  [HBCT]  Gunnery  manual.  The  MPLs  for  each  table  are  outlined  in 
Figure  1 . 


Minimum  ProllcMncy  LtvtM  (MPLs) 

Gunnery  Table 

II 

HI 

IV 

V 

VI 

OvM  Defensive  CnGsgefnent;  Dey  and  Night 

Y 

Y 

Y 

Y 

Y 

On*  Offwwiv*  Eng*g*m*n('  0*y  (nd  N>gnt 

Y 

Y 

Y 

Y 

Y 

One  Short  HaN  or  Traffic  Control  Pomt;  Day  OR 
Night 

Y 

Y 

Y 

Y 

Y 

One  Short  Range  Machine  Gun  Engagement.  Day 
OR  Night 

Y 

Y 

Y 

Y 

Y 

One  CBRN  Engegement:  Day  and  Night 

Y 

Y 

Y 

Y 

Y 

One  Short*Range  Engagement  Day  OR  Night 

Y 

Y 

Y 

Y 

One  Long  Range  Engagement:  Day  OR  Night 

Y 

Y 

Y 

Y 

OT  M  ii  Own  and  doaa  n«l  hava  any  MMan  Cun  rtqmfaiwanli  tf  GT  M  and  fV  an 

ftrtd  t^a  MPLs  for  CT  IV  apdiy. 

Tfw  Tana  ’fttiK)  Oun '  ratara  to  lha  25iani  and  tha  IMnim  tyalam* 

Tha  Tana  *tlacMna  Oun'  ra#afalolha  coaalady  wouwlad  and  CaMwi  .M  ayatama 


Weapon 

Short  Range  Engagement 

Long  Range  Engagement 

Machine  Gun 

<300m 

n;a 

25inM 

<S00m 

>140aM 

Ijemsi 

<S00m 

>3000m 

Figure  1 .  Minimum  Proficiency  Levels  for  Stabilized  Platforms  (from  Heavy  Brigade 

Combat  Team  [HBCT]  Gunnery,”  2009,  p.  16-7) 

The  gunnery  tables  the  command  develops  will  build  upon  each  other, 
ensuring  the  crew  is  proficient  on  their  actual  tank  with  the  weapon  systems  prior 
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to  executing  the  crew  qualification.  A  description  of  the  tables  as  outlined  in  the 
HBCT  gunnery  manual  is: 

a.  Gunnery  Table  1 

“Crew  Critical  Skills  consist  of  those  skills  that  are  critical  to 
the  safety  of  the  crew  and  essential  to  the  operation  of  the  combat 
platform  assigned.  Gunnery  Table  I  should  be  conducted  in 
garrison,  prior  to  the  gunnery  density”  (“Heavy  Brigade  Combat 
Team  [HBCT]  Gunnery,”  2009,  p.  16-12). 

b.  Gunnery  Table  2 

“Crew  Practice  Course  (CPC)  is  a  single  vehicle  CPC.  CPC  is 
designed  to  evaluate  the  crew’s  ability  to  engage  stationary  and 
moving  targets  placed  in  a  tactical  array  from  a  stationary  and 
moving  vehicle.  CPC  tasks  are  to  be  conducted  either  dry  or  device 
based  prior  to  using  the  .50  cal  inbore  device  (Abrams)  or  full 
caliber  ammunition”  (“Heavy  Brigade  Combat  Team  [HBCT] 
Gunnery,”  2009,  p.  16-13). 

c.  Gunnery  Table  3 

“Basic  Machine  Gun  is  a  single-vehicle  machine  gun  pure 
table.  Gunnery  Table  III  is  designed  to  evaluate  the  crew’s  ability  to 
engage  stationary  and  moving  targets  placed  in  a  tactical  array 
from  a  stationary  and  moving  vehicle  using  the  vehicle  mounted 
machine  guns”  (“Heavy  Brigade  Combat  Team  [HBCT]  Gunnery,” 

2009,  p.  16-15). 

d.  Gunnery  Table  4 

“Table  IV  is  a  single-vehicle  main  gun  pure  qualification  table. 
Gunnery  Table  IV  is  designed  to  evaluate  the  crew’s  ability  to 
engage  stationary  and  moving  targets  placed  in  a  tactical  array 
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from  a  stationary  and  moving  vehicle  using  the  main  gun”  (“Heavy 
Brigade  Combat  Team  [HBCT]  Gunnery,”  2009,  p.  16-17). 

e.  Gunnery  Table  5 

“Crew  Practice  is  a  single  vehicle  practice  table.  Gunnery 
Table  V  is  designed  to  train  the  crew  to  engage  moving  and 
stationary  targets  using  all  vehicle  weapon  systems.  It  requires  the 
crew  to  call  on  the  knowledge  gained  throughout  all  previous 
tables.  Gunnery  Table  V  will  prepare  the  crew  for  Gunnery  Table 
VI,  Crew  Qualification  by  presenting  them  with  tasks  that  require 
the  crew  to  use  all  the  aspects  of  their  fire  control  system  against  a 
variety  of  target  arrays”  (“Heavy  Brigade  Combat  Team  [HBCT] 
Gunnery,”  2009,  p.  16-21). 

f.  Gunnery  Table  6 

“Gunnery  Crew  Qualification  is  a  single  vehicle  qualification 
table.  Gunnery  Table  VI  is  designed  to  evaluate  the  crew  on 
engaging  moving  and  stationary  targets  using  all  vehicle  weapon 
systems  while  in  the  offensive  or  defensive  postures.  Gunnery 
Table  VI  must  be  fired  using  full  caliber  ammunition”  (“Heavy 
Brigade  Combat  Team  [HBCT]  Gunnery,”  2009,  p.  16-23). 

Each  of  these  gunnery  tables,  except  for  gunnery  Table  1,  use  the 
Department  of  Army  form  7657-R,  dated  September  2009  (see  Figure  2)  to 
record  the  crew’s  results.  The  result  of  each  of  the  tables  is  briefed  to  the  crew  by 
a  crew  evaluator  upon  completion  of  the  table.  The  crew  evaluator  has  the 
capability  to  listen  to  the  crew  as  they  conduct  the  tables,  and  based  upon  the 
range,  will  have  visual  footage  of  the  tank  and  the  targets  that  were  engaged  and 
potentially  video  footage  from  inside  the  tank.  This  allows  the  crew  evaluator  to 
conduct  a  thorough  after  action  review.  It  also  allows  the  crew  to  identify  issues 
and  conduct  additional  training  to  resolve  those  training  deficiencies. 
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Figure  2.  Crew  Score  Sheet  (from  “Heavy  Brigade  Combat  Team  [HBCT] 

Gunnery,”  2009) 

F.  ADVANCED  GUNNERY  TRAINING  SYSTEM 

The  Advanced  Gunnery  Training  System  (AGTS)  is  the  Army’s  simulator 
system  to  train  tank  commanders  and  gunners  on  proper  engagement 
techniques  and  procedures  prior  to  allowing  them  to  fire  live  on  the  real  tank. 

1.  Capabilities 

AGTS  as  a  simulator  is  designed  to  replicate  the  current  main  battle  tank 
of  the  United  States  Army,  the  M1A2.  The  AGTS  “utilizes  computer-generated 
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visual  scenes,  targetry,  and  special  effects  to  simulate  the  engagement  of 
targets.  The  majority  of  the  fire  control  system  is  replicated  in  both  physical  and 
functional  aspects.  The  system  trains  both  fully  operational  and  degraded-mode 
gunnery  techniques  under  a  wide  variety  of  conditions”  (“Tank  Gunnery  Training 
Devices  and  Usage  Strategies, ”2000,  p.  5-5).  The  individual  capabilities  and 
limitations  of  the  AGTS  are  detailed  below  as  described  in  the  Tank  Gunnery 
Training  Devices  and  Usage  Strategies  published  in  May  of  2000. 

a.  The  System  Simulates  the  Following  Visual  Effects 

•  Multiple,  single,  and  delayed  targets  (M1A1,  M1A2,  T-80, 
truck  with  snapper  ATGM,  T-72,  BMP,  BMP2,  BTR,  BRDM, 
ZSU-23-4,  HIND-D,  MI-8C,  truck  GAZ-69,  rocket-propelled 
grenade  [RPG]  team,  troops,  M1,  M2/M3,  M60A3,  AH-64, 
Leopard  1  and  2,  Marder,  AMX-10,  AMX-30,  Chieftain, 
Challenger,  M-113,  and  Merkava) 

•  Varied  ranges,  speeds,  exposure  times,  and  reactive  targets 

•  Own  vehicle,  moving  and  stationary 

•  Primary,  alternate,  and  subsequent  defensive  firing  positions 

•  Round  tracer 

•  Scene  obscuration 

•  Round  impact  and  effect  on  target 

•  Round  impact  on  terrain 

•  Catastrophic  kill 

•  Mobility  kill 

•  Burning  wreck  models 

•  Smoke  from  grenade  launchers 

•  Enemy  direct  and  indirect  fire 

•  Near  miss  on  own  vehicle 

•  Own  vehicle  hit  and  kill. 

b.  The  System  Provides  the  Following  Visibility  Conditions 

•  Day  unlimited 

•  Day  with  haze  (European  data  base) 

•  Day  with  dust  (desert  data  base) 
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•  Day  with  fog 

•  Dawn  and  dusk 

•  Night  unlimited  (thermal) 

•  Night  with  thermal  clutter 

•  Mortar  illumination 

c.  The  System  Provides  the  Following  Aural  Cues  to  the  Crew 

•  Enemy  fire,  including  artillery 

•  Round  loading  and  reloading  sounds 

•  Loader’s  “UP” 

•  Main  gun,  M240,  and  M2  machine  gun  firing 

•  Track  clatter 

•  Engine  and  transmission  sounds 

•  Gun  jump 

•  TIS  cooling  fan 

•  NBC  system 

•  CITV  fan  and  shutter 

•  Own  vehicle  hit  and  kill 

•  Friendly  fire 

2.  Training  and  Usage  Strategy 

The  HBCT  Gunnery  manual  describes  the  AGTS  as  “a  family  of  tank 
gunnery  training  simulators  for  VC/gunner  teams.  Its  primary  purpose  is  to 
train/sustain  basic  gunnery  skills  and  increase  combat  gunnery  skills.  The  AGTS 
places  the  VC  and  gunner  in  a  realistically  simulated  crew  station  and  presents 
them  with  a  full  range  of  computer-controlled  engagement  situations.  The  AGTS 
produces  full-color,  computer-generated  action  scenes  in  which  crew  members 
interact  with  various  target  situations.  Programmed  exercises  vary  in  target  type 
and  number,  range,  vehicle  and  target  motion,  visibility,  and  other  complex 
conditions”  (“Heavy  Brigade  Combat  Team  [HBCT]  Gunnery,”  2009,  p.  11-20). 
The  United  States  Army  mandates  the  use  of  the  AGTS  to  train  the  tank 
commander  and  gunner. 
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The  HBCT  Gunnery  Manual  recommends  a  minimum  of  four  hours  of 
training  in  the  AGTS  for  each  crew  per  month  to  ensure  the  crew  is  able  to 
execute  all  of  the  exercises  and  be  ready  to  move  onto  the  live  gunnery  tables. 
This  recommendation  of  four  hours,  while  sounding  rather  easy  to  achieve,  is 
actually  difficult  when  commanders  must  balance  other  missions  and  training 
requirements.  If  a  tank  company,  comprised  of  14  tanks,  executes  the  four  hours 
of  training  per  month,  it  totals  to  56  hours  of  actual  training.  Generally  a  brigade 
conducts  gunnery  train-up  at  any  given  time.  This  would  equate  under  the  current 
two  maneuver  battalion  construct  of  four  tank  companies,  or  56  tank  crews 
needing  to  train.  These  calculations  equate  to  224  hours  a  month  the  brigade 
needs  to  be  training  these  crews  to  meet  the  guidelines  set  forth  by  the  HBCT 
Gunnery  Manual.  This  time  does  not  include  setup  time,  time  for  after  action 
review,  or  the  availability  of  the  system  on  which  to  conduct  training.  The  major 
constraint  most  units  face  is  the  availability  of  the  system.  While  theoretically 
Soldiers  are  on  duty  24  hours  a  day,  seven  days  a  week,  it  is  not  a  realistic 
expectation  to  expect  the  training  to  occur  around  the  clock.  Contractors  primarily 
maintain  and  operate  the  simulators;  therefore,  commanders  must  take  into 
account  the  budgetary  aspects  of  conducting  simulator  training.  Units  will 
schedule  the  use  of  the  AGTS,  and  depending  on  where  they  are  in  the  gunnery 
training  program,  some  units  may  have  priority  over  others  on  usage  of  the 
system. 

Commanders,  as  they  determine  the  proficiency  of  their  crews,  must 
determine  at  what  level  of  exercises  the  crew  will  start  training  in  the  AGTS. 
These  varying  requirements  for  crews  based  upon  experience  level  do  not  fit  well 
with  the  four  hour  recommended  time  stated  in  the  manual.  As  commanders 
assess  their  crews’  level  of  proficiency,  they  will  make  the  decision  on  how  much 
time  crews  will  receive  in  the  simulator.  The  main  priority  for  commanders  is  to 
ensure  all  crews  pass  the  GTLF  exercises,  since  a  crew  cannot  conduct  live-fire 
until  this  requirement  is  met.  With  the  priority  being  GTLF,  a  crew  that 
successfully  passes  it  exercises  quickly,  no  matter  what  their  experience  level 
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will  generally  lose  any  more  simulator  time  to  allow  crews  with  less  success  the 
opportunity  to  fulfill  the  necessary  requirements.  This  focus  on  the  end  state  of 
passing  GTLF  precludes  the  additional  training  the  ACTS  can  provide  a  crew. 
The  process  ultimately  becomes  a  “check  the  box”  in  the  process  to  fire  live 
instead  of  being  used  as  a  training  tool  as  it  was  designed. 

3.  Gate  to  Live  Fire 

The  commander  must  ensure  that  each  tank  commander  and  gunner 
combination  satisfactorily  completes  the  Gate  to  Live  Fire  (GTLF)  exercises.  The 
requirement  is  for  the  tank  commander  and  gunner  to  score  at  least  700  out  of  a 
possible  1000  points  over  the  course  of  ten  engagements.  Each  engagement 
must  also  be  passed  with  a  minimum  of  70  points.  Any  major  safety  or  crew 
violations  throughout  the  GTLF  result  in  the  crew  failing  the  GTLF.  While  the 
GTLF  is  the  culminating  simulation  event  for  the  tank  commander  and  gunner, 
the  commander  dictates  the  amount  of  exercises  they  conduct  prior  to  it  and 
determines  whether  the  crew  successfully  progresses  through  the  dictated 
exercises.  The  commander  may  establish  the  baseline  exercises  a  crew  must 
conduct,  but  the  computer  system  that  has  the  AGTS  exercises  also  compares 
the  crew’s  performance  and  determines  what  exercises  they  must  accomplish  to 
be  ready  to  execute  the  GTLF.  The  computer  will  not  allow  a  crew  to  execute  the 
final  GTLF  unless  it  satisfactorily  completes  the  previous  exercises. 

4.  Limitations 

The  following  list  of  items  are  not  functionally  simulated  or  represented  on 
the  AGTS: 

•  TC's  periscopes.  The  three  forward  unity  periscopes  are 
operational;  the  other  periscopes  around  the  TC's  hatch  are 
not  functional 

•  TC's  hatch  will  not  open 

•  M2  machine  gun  is  not  replicated  on  the  AGTS 

•  Not  all  circuit  breakers  are  supported  from  the  display  panels 
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•  Hydraulic  pressure  gauge 

•  Gunner's  unity  periscope 

•  Ammunition  temperature  gauge 

•  Gunner's  TIS  focus  knob 

•  M240  machine  gun.  The  M240  machine  gun  is  partially 
simulated.  Manual  fire  cannot  be  accomplished.  The 
charging  handle  can  be  used  to  apply  immediate  action  for 
simulated  stoppages. 

•  Driver's  and  loader's  stations  are  not  simulated 

Of  the  limitations  listed  above,  three  are  of  most  concern:  the  lack  of  M2 
machine  gun  replication,  the  driver  and  loader’s  stations  only  being  simulated  in 
a  very  basic  way,  and  the  lack  of  hydraulic  system  simulation.  Although  the 
capabilities  of  the  AGTS  are  numerous,  the  inability  of  the  tank  commander  to 
practice  engagements  with  the  .50  caliber  machine  gun  is  of  concern.  The  tank 
commander  will  get  to  fire  this  weapon  system  during  gunnery  as  it  is  a 
requirement  through  all  but  Table  IV,  main  gun  only.  The  lack  of  this  machine 
gun  in  the  AGTS  denies  the  tank  commander  the  experience  of  simulated  firing 
of  this  weapon  system,  or  conducting  simulated  engagements  that  would 
incorporate  this  weapon  with  other  weapon  systems  of  the  tank. 

The  replication  of  the  loader  and  driver  removes  the  variability  of  how  long 
a  loader  takes  to  load  a  round  and  the  driver’s  capability  to  maintain  a  steady 
speed  or  pull  up  into  the  fighting  position  to  fire.  This  gives  a  false  sense  of  the 
impact  both  members  of  the  crew  have  on  success  or  failure  of  the  actual 
engagement.  While  minimizing  variability  to  allow  new  tank  commanders  and 
gunners  to  focus  on  their  specific  tasks,  the  instructor/operator  is  not  afforded  the 
capability  to  introduce  this  variability  as  a  crew  becomes  more  proficient.  This 
lack  of  variability  in  the  AGTS  results  in  new  tank  commanders  and  gunners 
having  the  variability  due  to  the  loader’s  and  driver’s  abilities  first  introduced 
during  the  actual  live-fire  tables. 

The  AGTS  uses  electricity  to  run  its  systems.  The  actual  tank  is  run  by 
hydraulics.  There  is  a  difference  in  how  the  turret  turns  and  the  actual  firing  of  the 
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weapon  system.  Although  the  difference  is  slight,  it  is  noticeable  and  may  impact 
a  gunner’s  performance.  Gunners  with  little  experience  may  have  difficulty 
transitioning  as  the  tank  responds  differently;  there  is  a  minimal,  but  a  noticeable 
difference  in  time  between  the  input  the  gunner  induces  through  his  controls  and 
the  response  by  the  tank.  This  is  not  replicated  in  the  AGTS  and  can  result  in  a 
new  gunner  having  negative  training  transfer  from  the  AGTS  to  the  real  tank. 
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II.  METHODS 


The  previous  chapter  outlined  how  the  Army  envisions  conducting  armor 
gunnery  training.  Studies  have  been  conducted  to  try  and  determine  how 
effective  the  simulator  is  at  training  crews  prior  to  conducting  live-fire  gunnery  on 
the  real  tank,  with  the  last  study  being  conducted  over  20  years  ago.  The 
purpose  of  this  thesis  study  is  to  determine  if  there  is  an  association  between 
ACTS  and  live-fire  gunnery  performance.  This  chapter  describes  the 
methodology  of  the  thesis  study,  in  particular,  the  demographic  characteristics  of 
the  participants,  the  variables  of  interest,  the  selected  ACTS  and  live-fire 
exercises,  equipment,  and  procedures. 

A.  PARTICIPANTS 

In  order  to  assess  training  transfer  from  ACTS  to  live-fire  among  officers 
completing  their  first  M1  Abrams  tank  course,  65  officers  assigned  to  the  Armor 
School  Basic  Officer  Course  were  recruited  and  participated  in  the  study. 
Participants  had  served  in  the  active  Army  {n  =  40),  National  Guard,  {n  =22),  or 
foreign  armies  {n  =3)  with  an  average  of  2.58  years  of  service  {sd  =  0.337). 
Participants  ranged  in  age  from  22  to  38  years  (mean  age  was  24.78  years). 
Although  17  participants  had  a  prior  military  occupational  specialty  indicating 
prior  military  service  and  training,  none  of  these  specialties  were  related  to 
operating  the  Ml  Abrams  tank.  Three  officers  had  participated  in  live-fire  gunnery 
prior  to  this  study;  however  these  officers  had  received  training  different  from  the 
current  course  of  instruction  and  on  different  platforms  than  the  Ml  Abrams  tank. 
Thus,  all  participants  were  in  their  initial  training  course  on  the  Ml  Abrams  tank 
and  had  no  prior  experience  with  the  Ml  Abrams  tank. 

B.  VARIABLES  OF  INTEREST 

The  variables  of  interest  used  to  assess  training  transfer  were  overall  crew 

score,  time  to  identify  the  first  target,  time  to  kill  the  first  and/or  second  target, 

and  hit  or  miss  of  the  target.  All  variables  of  interest  were  recorded  on  the  Crew 
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Score  sheet,  DA  Form  7657-R  dated  September  2009  by  both  the  ACTS  and 
during  the  live-fire  gunnery  exercises.  The  computer  program  in  the  ACTS 
automatically  generates  the  score  sheet  based  upon  data  automatically  collected 
during  the  engagements  conducted  in  the  ACTS.  Vehicle  Crew  Evaluators  (VCE) 
collected  the  data  for  each  engagement  during  the  live-fire  gunnery.  Based  on 
the  crew  score  sheet,  the  continuous  variables  were  the  overall  crew  score,  the 
time  to  identify  the  first  target,  and  the  time  to  engage  the  first  target  and  the 
second  target.  The  one  categorical  variable  was  whether  a  participant  hit  or 
missed  the  target.  Below  are  descriptions  of  how  each  variable  of  interest  was 
measured. 

1.  Overall  Crew  Score 

The  overall  crew  score  is  a  compilation  of  the  times  recorded  on 
identification  of  the  target  and  the  time(s)  the  target(s)  were  hit.  If  the  crew  makes 
an  error  such  as  an  improper  fire  command  or  a  safety  violation,  the  crew  may 
lose  points.  The  crew’s  time  in  the  defilade,  while  conducting  a  defensive 
engagement,  is  also  factored  into  the  overall  score.  The  maximum  score  a  crew 
can  receive  is  100  points.  The  minimum  score  to  have  a  qualified  run  is  70 
points,  although  the  score  is  recorded  to  a  minimum  of  zero  points. 

2.  Time  to  Identify  the  First  Target 

The  time  is  started  when  the  target  first  appears.  In  the  ACTS,  the 
computer  annotates  the  time  when  the  target  is  first  presented.  In  the  live-fire 
gunnery,  the  time  is  started  when  the  target  is  locked  in  the  up  position.  The  time 
for  identification  is  recorded  when  one  of  the  crew  states  “identified”.  This 
variable  was  measured  in  seconds. 

3.  Time  to  Kill  the  First  and/or  Second  Target 

The  time  is  started  when  the  target  first  appears.  In  the  ACTS,  the 
computer  annotates  the  time  when  the  target  is  first  presented.  In  the  live-fire 
gunnery,  the  time  is  started  when  the  target  is  locked  in  the  up  position.  The  time 
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for  engagement  is  recorded  when  the  target  is  hit,  or  the  target  lowers  based 
upon  the  exposure  time  of  the  target  being  met.  This  variable  was  measured  in 
seconds. 

4.  Hit  or  Miss  of  a  Target 

The  hit  or  miss  of  a  target  in  the  ACTS  is  displayed  to  the  crew  as  a 
vehicle  “burning”.  The  computer  records  the  hit  or  miss,  along  with  how  many 
rounds  were  fired  at  that  target  and  where  the  reticle  was  aiming  at  the  time  the 
rounds  were  fired.  During  the  live-fire  gunnery,  the  VCE  records  using  a  Forward 
Looking  Infrared  (FLIR)  sight  focused  on  the  target  to  watch  for  the  impact  of  the 
round.  Each  round  has  a  tracer  element  in  the  back  of  the  warhead  that  burns 
after  it  leaves  the  barrel  allowing  for  FLIR  and  normal  eyesight  tracking.  A  hit  was 
recorded  based  upon  the  round  passing  through  the  target  and/or  the  target 
moving  from  the  raised  to  lowered  position.  Hits  were  recorded  as  such,  with 
misses  being  recorded  as  miss,  lost,  over,  or  short.  A  lost  round  is  one  where  the 
VCE  has  determined  the  round  did  not  hit  the  target,  but  could  not  identify  exactly 
where  the  round  passed  in  regards  to  the  target.  A  round  that  goes  over  the 
target  is  one  that  the  VCE  sees  as  going  over  the  target.  A  short  round  is  one 
that  hits  short  of  the  target. 

C.  EXERCISES 

While  participants  executed  numerous  exercises  in  the  ACTS,  only  the 
results  of  two  exercises  were  captured  for  comparison  to  the  live-fire  results. 
These  two  ACTS  exercises,  26081141  and  36011101,  were  similar  to  the 
modified  live-fire  gunnery  Table  V  and  VI.  Since  ACTS  does  not  replicate  the 
tank  commander’s  .50  caliber  heavy  machinegun,  the  modified  live-fire  gunnery 
engagements  that  used  this  weapon  system  were  not  used  in  the  statistical 
analysis.  A  total  of  two  engagements  for  Table  V  and  Table  VI  were  selected 
based  upon  types  of  targets  engaged  with  particular  weapon  systems. 
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1. 


ACTS  Exercises 


Participants  conducted  various  exercises  in  the  ACTS  during  a  week-long 
training  program.  These  exercises  were  used  by  the  instructors  to  teach  the 
participants  how  to  correctly  operate  the  tank  and  engage  targets.  The  training 
program  culminated  with  the  participants  executing  exercise  26081141  and 
36011101. 

a.  AGTS  Exercise  26081141 

Exercise  26081141  was  selected  as  it  was  the  last  exercise  conducted 
prior  to  the  GTLF  exercise.  This  exercise  was  determined  to  be  similar  to  a 
participant  firing  Table  V  which  is  the  practice  exercise  prior  to  the  participant 
live-fire  qualification.  This  exercise  was  used  to  evaluate  a  participant’s 
performance  and  whether  they  were  able  to  progress  to  the  GTLF  exercise.  A 
total  of  ten  engagements  were  conducted  in  the  exercise.  Three  particular 
engagements  were  selected  that  were  similar  to  targets  the  participant  would 
engage  in  their  initial  live-fire  gunnery.  Of  these  three  engagements,  two  were 
chosen  for  statistical  analysis  with  the  live-fire  Table  V  engagements.  The  first 
engagement  was  an  individual  tank  which  required  the  use  of  the  main  gun  only. 
The  second  engagement  was  a  PC  and  light  vehicle  which  required  the 
participant  to  engage  using  the  main  gun,  and  also  the  Coaxial  Machinegun 
(COAX). 

b.  AGTS  Exercise  3601 1101 

Exercise  36011101  was  the  participants’  GTLF  exercise.  The  participant  is 
required  to  pass  this  exercise  to  progress  to  the  live-fire  exercises.  This 
requirement  as  a  final  exercise  is  similar  to  the  participant  completing  the  Table 
VI  live-fire  qualification. 

This  exercise  was  the  participant’s  GTLF  exercise,  the  final  exercise 
before  they  executed  live-fire  gunnery.  A  total  of  ten  engagements  were 
conducted  in  the  exercise.  Two  particular  engagements  were  selected  as  they 
closely  resembled  the  engagements  that  the  participants  conducted  during  their 
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final  live-fire  gunnery  evaluation.  The  first  engagement  was  an  individual  tank 
which  required  the  use  of  the  main  gun  only.  The  second  engagement  was  two 
tanks  which  required  the  use  of  the  main  gun  only. 

The  computer  system  that  runs  the  simulation  used  by  the  ACTS  also 
captures  all  of  the  variables  used  for  this  study. 

2.  Live 

The  participants  conducted  two  live-fire  gunnery  iterations.  The  first 
iteration  was  the  first  time  these  participants  fired  the  tank  with  live  ammunition. 
The  participants  executed  a  total  of  five  engagements  during  this  first  iteration. 
Four  of  the  five  engagements  were  selected  as  they  were  similar  to 
engagements  participants  had  seen  in  the  ACTS  exercise  26081141.  The  fifth 
was  not  used  as  it  included  an  engagement  that  cannot  be  replicated  in  the 
ACTS,  a  target  that  the  commander  must  engage  using  his  .50  caliber  machine 
gun.  The  four  engagements  were  two  PCs,  one  tank,  one  PC  with  troops,  and 
one  tank  with  troops.  The  two  PCs  and  one  tank  engagements  were  main  gun 
only  while  the  PC  with  troops  and  tank  with  troops  required  the  participant  to  use 
main  gun  and  COAX.  Of  these  four  engagements,  only  two  were  used  to  conduct 
statistical  analysis  with  the  AGTS  exercise  26081141.  The  first  engagement  was 
an  individual  tank  which  required  the  use  of  the  main  gun  only.  The  second 
engagement  was  a  PC  and  troops  which  required  the  participant  to  engage  using 
the  main  gun,  and  also  the  COAX.  Table  1  outlines  the  AGTS  and  live-fire 
exercises  that  were  compared  to  each  other. 

The  second  iteration,  the  participant’s  final  evaluation,  the  Table  6 
modified  live-fire,  was  a  total  of  three  engagements.  One  engagement  was  not 
used  for  the  same  reason  that  it  required  the  commander  to  use  his  .50  caliber 
machinegun  to  engage  the  target.  The  other  two  engagements  were  selected  for 
statistical  analysis  with  AGTS  exercise  36011101  due  to  their  similarity  with  the 
engagements  in  AGTS  exercise  36011101.  The  first  engagement  was  an 
individual  tank  which  required  the  use  of  the  main  gun  only.  The  second 
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engagement  was  two  tanks  which  required  the  use  of  the  main  gun  only.  Table  2 
outlines  the  ACTS  and  live-fire  exercises  that  were  compared  to  each  other. 


Engagements 
Used  for  Study 

AGTS  Exercises  26081141  (Table  5) 

Live  Fire  Gunnery  M  odifled  Tables 

Target  Type  1 

Target  Type  2 

Target  Type  1 

Target  Type  2 

Engagement  One 

Tank 

N/A 

Tank 

N/A 

Engagement  Two 

Personnel  Carrier 

Car 

Personnel  Carrier 

Troops 

Table  1.  AGTS  And  Table  5  Engagements 


Engagements 
Used  for  Study 

AGTS  Exercises  36011101  (Table  6) 

Live  Rre  Gunnery  M odifled  Table  6 

Target  Type  1 

Target  Type  2 

Target  Type  1 

Target  Type  2 

Engagement  One 

Tank 

N/A 

Personnel  Carrier 

N/A 

Engagement  Two 

Personnel  Carrier 

Personnel  Carrier 

Tank 

Tank 

Table  2.  AGTS  and  Table  6  Engagements 


D.  SURVEY 

Each  participant  was  asked  to  complete  an  anonymous  survey  upon 
finishing  their  final  live-fire  gunnery  exercise.  This  survey  recorded  the 
demographics  of  the  participants,  their  previous  gunnery  training,  how  well  they 
thought  the  AGTS  trained  them  on  each  of  several  tasks,  and  their  opinion  as  to 
what  made  an  effective  gunnery  training  program.  It  also  allowed  the  participants 
to  identify  what  other  gunnery  training  they  received  and  their  perception  of  how 
that  training  benefited  them  in  preparing  them  for  live-fire  gunnery.  Ten  specific 
tasks  identified  as  being  trained  by  the  AGTS  were  included  in  the  survey.  The 
participants  indicated  whether  they  felt  the  AGTS  actually  accomplished  this 
training  compared  to  live-fire  gunnery.  The  final  question  asked  each  participant’s 
thoughts  on  what  made  an  effective  gunnery  training  program.  See  the  appendix 
for  the  actual  survey  questions. 
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E.  EQUIPMENT 

The  study  compared  participants  on  two  pieces  of  equipment,  The  M1A2 
SEPv2  main  battle  tank  and  the  ACTS. 

1.  M1A2  SEPv2  Main  Battle  Tank 

The  M1A2  SEPv2  tank  (see  Figure  3)  is  the  Army’s  front  line  tank.  The 
tank  is  capable  of  firing  on  the  move  with  targeting  solutions  determined  by  the 
embedded  computer  receiving  data  from  the  laser  range  finder  and  other  on 
board  systems.  The  tank  is  equipped  with  digital  command  and  control  systems 
that  allow  the  tank  commander  to  communicate  using  the  Army’s  Force  XXI 
Battle  Command  Brigade  and  Below  (FBCB2).  It  also  is  equipped  with  standard 
FM  radios. 

The  tank  weaponry  consists  of  a  120mm  smooth  bore  main  gun,  one 
7.62mm  coaxial  machinegun,  one  7.62mm  machinegun  operated  by  the  loader, 
and  a  .50  caliber  heavy  machinegun  operated  by  the  tank  commander. 

The  gunner  has  a  primary  and  an  auxiliary  sight  that  the  tank  commander 
can  also  see  through.  The  tank  commander  also  has  a  digital  Commander’s 
Independent  Thermal  Viewer  (CITV)  that  he  can  use  to  spot  and  designate 
targets. 

The  M1A2  SEPv2  tanks  used  by  the  participants  during  the  live-fire 
gunnery  are  maintained  and  issued  by  the  Directorate  of  Training  Sustainment. 


Figure  3.  M1A2  SEPv2  Main  Battle  Tank 
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2. 


ACTS 


The  AGTS  is  a  simulator  that  replicates  the  gunner  and  tank  commander 
stations  for  the  M1A2  SEPv2  tank  (see  Figure  4).  The  layout  is  an  exact  replica 
of  the  interior  of  the  tank  with  some  minor  differences.  The  simulator  use 
computer  generated  graphics  to  portray  what  the  gunner  and  tank  commander 
see  through  the  sights  or  periscopes,  whether  normal  optical  or  thermal. 

The  coaxial  machinegun  is  replicated  in  the  simulator,  but  the  gunner 
cannot  manipulate  the  gun  as  is  possible  on  the  real  tank.  The  breach  of  the 
120mm  main  gun  is  replicated  in  its  unfired  position,  but  does  not  move  up  and 
down  as  the  gunner  moves  his  control  handles.  The  gun  also  does  not  recoil  like 
the  real  gun  does  when  the  gunner  or  tank  commander  fires  the  main  gun.  The 
driver  and  loader  positions  are  replicated  by  the  instructor/operator. 

The  AGTS  is  maintained  and  operated  by  personnel  at  the  Clarke 
Simulation  Center  on  Fort  Benning,  Georgia.  The  unit  provides  trained  non¬ 
commissioned  officers  to  be  the  instructor/operators  (I/O)  for  the  training  of  the 
participants. 


Figure  4.  Advanced  Gunnery  Training  System  (from  au-corp.com,  2014) 
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F.  PROCEDURES 

The  overall  concept  of  the  study  was  to  not  interfere  with  the  already 
established  training  program  for  armor  crew  gunnery.  The  participants  executed 
ACTS  followed  by  the  live-fire.  The  survey  was  provided  to  the  participants  at  the 
conclusion  of  their  live-fire  gunnery.  IRB  approval  was  attained  prior  to  data 
collection. 

The  ACTS  data  was  collected  by  the  individual  crew  I/O.  This  data  was 
printed  for  each  individual  participant  with  the  tank  commander  identified  as  the 
primary  trained  individual.  The  two  exercise  series  collected  were  numbered 
26081141  and  36011101.  These  two  exercise  series  were  equitable  to  the  two 
live-fire  exercises  conducted. 

As  per  the  established  training  program,  The  I/O  had  the  participants’ 
progress  through  various  exercises.  Based  upon  the  participants’  progress,  and 
the  remaining  training  time,  the  I/O  determined  if  the  participants’  would  progress 
through  all  of  the  exercises,  or  culminate  prior  to  completing  the  36011101, 
GTLF.  The  I/O  made  this  determination  based  upon  his  experience  on  whether 
the  participant  was  prepared  to  execute  the  live-fire  gunnery  safely. 

Upon  completion  of  the  ACTS  training,  the  participants  moved  to  the  live- 
fire  portion  of  the  training  program.  Each  participant  fired  five  total  engagements 
for  the  first  exercise.  This  was  the  first  time  any  of  the  participants  had  fired  live 
from  a  tank.  The  engagements  were  observed  and  recorded  by  the  VCEs  on  the 
crew  score  sheet.  The  results  of  the  exercise  were  briefed  to  each  individual 
participant  in  their  AAR.  A  copy  of  all  score  cards  was  made  and  provided  to  the 
study  team. 

The  final  live  gunnery  exercise  consisted  of  three  engagements.  This 
exercise  was  also  considered  the  participants’  final  evaluation  in  the  gunnery 
training  program  for  the  unit.  The  engagements  were  observed  and  recorded  by 
the  VCEs  on  the  crew  score  sheet.  The  results  of  the  exercise  were  briefed  to 
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each  individual  participant  in  their  AAR.  A  copy  of  all  score  cards  was  made  and 
provided  to  the  study  team. 

After  the  participant  had  completed  their  final  live-fire  exercise,  they  filled 
out  their  survey.  This  survey  was  provided  in  paper  copy  to  each  participant  who 
filled  it  out  with  a  pen  or  pencil.  Once  the  participant  completed  the  survey,  they 
placed  them  in  a  separate  file  folder. 
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III.  RESULTS 


This  chapter  discusses  the  statistical  results  of  the  study.  First,  the 
preliminary  results  provide  an  overview  and  side  by  side  comparison  of 
participants’  performance  in  the  ACTS  and  live  fire  exercises.  Next,  the  main 
research  question  of  whether  there  is  a  correlation  between  the  results  of  the 
participant’s  performance  in  the  ACTS  and  their  performance  during  live  fire 
gunnery  is  addressed.  The  research  question  is  addressed  separately  for  Table  5 
and  Table  6. 

Finally,  an  opportunity  to  conduct  a  comparison  between  participants  who 
had  completed  the  ACTS  GTLF  exercise  36011101  and  those  that  had  not 
resulted  when  the  training  unit  allowed  instructors  to  certify  a  participant  was  safe 
to  execute  live  fire  gunnery  whether  or  not  they  had  completed  the  ACTS  GTLF. 
To  complete  all  of  the  AGTS  exercises,  the  participant  had  to  have  completed  the 
Gate  to  Live  Fire,  exercise  36011101.  A  total  of  34  participants  completed  the 
GTLF  and  30  did  not.  Therefore,  exploratory  analyses  were  conducted  to 
determine  whether  participants  performed  better  if  they  had  completed  all  of  the 
AGTS  exercises  compared  to  those  that  had  not  completed  all  of  the  AGTS 
exercises.  For  all  of  the  statistical  analyses  reported  in  this  chapter,  a  two-tailed 
0=0. 05  was  used. 

A.  PRELIMINARY  RESULTS 

Prior  to  testing  the  main  hypothesis  of  how  people  performed,  descriptive 
statistics  on  participants’  performance  in  the  AGTS  and  live  fire  exercises  were 
calculated.  Paired  t-tests  next  were  completed  to  determine  if  participants 
performed  significantly  better  or  worse  in  the  live  fire  exercise  compared  to  the 
AGTS  exercise. 

Table  3  shows  the  summary  of  results  for  AGTS  exercise  26081141  and 
gunnery  Table  5.  There  was  a  trend  for  participants  to  do  better  in  the  AGTS  than 
in  the  live  fire  gunnery  for  the  overall  score  (f(11)  =  2.087,  p=.061).  There  were 
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no  significant  differences  for  (kill  times  of  the  first  target:  t{^^)  =  -0.221,  p=0.829; 
or  kill  times  of  the  second  target  t{4)  =  -0.829,  p=0.454).  Results  from  a  two 
proportion  z  test  also  indicated  no  significant  difference  in  the  hit  rate  percentage 
of  75%  for  ACTS  and  81 .30%  for  the  modified  live  fire  gunnery  Table  5. 


Table  5 

AGTS  Exercise  26081141 

Live  Fire  Gunnery  Modified 

Overall  Score 

47.667(44.75),  0-100  (n=12) 

23.083(32.469),  0-89  (n=12) 

ID  Time 

N/A 

N/A 

Kill  Time  Target  One 

33.942(14.665),  3.9-58  (n=12) 

35.667(18.242),  14-67  (n=12) 

Kill  Time  Target  Two 

72.06(14.472),  52.5-87.6  (n=5) 

90.8(55.899),  42-180  (n=5) 

Hit  Rate  Percentage 

75% 

81.30% 

Table  3.  Summaries  of  Results  (Table  5):  Mean  (SD),  range 

(sample  size) 


Table  4  shows  the  summary  of  results  for  ACTS  exercise  36011101  and 
gunnery  Table  6.  Results  from  paired  t-tests  showed  that  participants  did 
significantly  better  in  the  ACTS  than  in  the  live  fire  gunnery  for  the  overall  score 
(f(66)  =  3.975,  p=.0002  and  identification  time  (f(33)=-3.899,  p=.0004),  and  hit 
rate  percentage  of  97%  for  ACTS  and  66.70%  for  the  modified  live  fire  gunnery 
Table  6.  However,  participants  did  significantly  better  in  the  live  fire  for  the  kill 
time  of  the  first  target  (f(64)  =  2.157,  p=0.035)  and  the  kill  time  of  the  second 
target  (f(31)  =  5.579,  p<0.0001). 


Table  6 

AGTS  Exercise  36011101 

Live  Fire  Gunnery  Modified 

Overall  Score 

73.522(28.784),  0-100  (n=67) 

49.03(36.603),  0-100  (n=67) 

ID  Time 

9.147(4.027),  4.2-18.3  (n=34) 

21.529(17.173),  5-79  (n=34) 

Kill  Time  Target  One 

31.694(14.603),  11.6-65.1  (n=65) 

24.908(17.349),  6-91  (n=65) 

Kill  Time  Target  Two 

61.619(19.682),  31.5-100.5  (n=32) 

36.313(13.025),  17-79  (n=32) 

Hit  Rate  Percentage 

97% 

66.70% 

Table  4.  Summaries  of  Results  (Table  6):  Mean  (SD),  range 

(sample  size) 
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B.  MAIN  HYPOTHESIS 


Is  there  a  correlation  between  the  crew  score  during  the  Gate  to  Live  Fire 
(GTLF)  exercise  utilizing  the  Advanced  Gunnery  Training  System  and  Table  5 
and  6  live  fire  gunnery? 

The  main  hypothesis  was  tested  using  Pearson  correlations  on  all 
variables  of  interest:  overall  crew  score,  time  to  identify  the  first  target,  time  to  kill 
the  first  target,  time  to  kill  the  second  target,  and  the  hit  or  miss  of  the  target. 
Below,  results  from  gunnery  Table  5  are  shown,  followed  by  results  from  gunnery 
Table  6. 

1.  Gunnery  Table  5  Results 

There  was  no  significant  correlation  between  the  AGTS  and  modified  live 
fire  performance  of  participants  for  overall  crew  scores  (/^0.478,  p=0.12),  first 
target  kill  time  {r=-0.347,  p=0.269),  second  target  kill  time  {r=0.483,  p=0.41). 
Results  were  not  captured  time  to  identify  the  first  target  in  the  AGTS  exercise 
26081141  and  gunnery  Table  5.  The  engagements  in  gunnery  Table  5  that  were 
the  most  similar  to  the  AGTS  were  offensive  engagements.  Offensive 
engagements  do  not  have  a  recorded  identification  time  in  the  live  fire  gunnery. 
Regarding  the  percentage  of  hits,  the  sample  size  was  not  large  enough  to 
determine  what  the  conditional  probability  was  for  the  gunnery  Table  5  hit  or  miss 
of  targets.  There  is  a  trend  though,  that  if  a  participant  hit  in  the  AGTS,  they  will 
hit  in  the  modified  live  fire  gunnery  (see  Table  5). 


Live 

AGTS 

Hit 

Miss 

Totals 

Hit 

10 

2 

12 

Miss 

3 

1 

4 

Totals 

13 

3 

16 

Table  5.  Number  of  Hits  and  Misses  for  AGTS  Exercise 
26081141  and  Gunnery  Table  5 
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2.  Gunnery  Table  6  Results 

There  was  no  significant  correlation  between  the  performance  in  overall 
crew  score  in  the  AGTS  and  in  the  modified  live  fire  {r=-0.M8,  p=0.15),  time  to 
identify  the  first  target  {r=-0.23,  p=0.19),  or  for  the  second  target  kill  time  {r=- 
0.198,  p=0.277).  However,  there  was  a  significant  correlation  between  first  target 
kill  time  in  AGTS  and  live  fire  {r=-0.255,  p=0.04).  Finally,  conditional  probability 
calculations  demonstrate  that  given  that  a  participant  had  a  hit  in  the  AGTS, 
there  is  66.7%  likelihood  that  they  would  also  have  a  hit  in  the  modified  live  fire 
gunnery.  (Probability  of  an  AGTS  hit  was  99/102=0.971.  The  probability  of  an 
AGTS  hit  and  a  live  hit  was  66/99=0.647).  Table  6  shows  the  raw  number  of  hits 
and  misses  between  AGTS  and  live-fire  gunnery. 


Live 

Hit 

Miss 

Totals 

AGTS 

Hit 

66 

33 

99 

Miss 

2 

1 

3 

Totals 

68 

34 

102 

Table  6.  Number  of  Hits  and  Misses  for  AGTS  Exercise 
36011101  and  Gunnery  Table  6 

C.  EXPLORATORY  ANALYSIS 

Exploratory  analyses  were  conducted  to  determine  if  there  was  a 
statistical  significant  difference  in  live  fire  performance  between  those  who  had 
completed  all  of  the  AGTS  exercises  and  those  that  had  not.  To  complete  all  of 
the  AGTS  exercises,  the  participant  had  to  have  completed  the  Gate  to  Live  Fire, 
exercise  36011101.  F  tests  for  equal  variances  indicated  that  two  sample  f-tests 
assuming  equal  variances  could  be  used  for  all  the  exploratory  analyses. 
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1. 


Overall  Crew  Score 


There  was  a  trend  for  participants  who  completed  ACTS  to  score 
higher  than  those  who  did  not  complete  the  ACTS  (f(124)=1 .902,  p=0.059)  (see 
Table  7). 


Overall  Score 

Participant  Who 
Completed  AGTS 

Participant  Who  Did 
Not  Complete  AGTS 

Mean 

49.03 

36.933 

Standard  Deviation 

36.603 

34.835 

Observations 

67 

60 

Hypothesized  Mean  Difference 

0 

df 

125 

tStat 

1.902 

P(T<=t)  two-tail 

0.059 

t  Critical  two-tail 

1.979 

Table  7.  Overall  Score  t-Test:  Two-Sample  Assuming  Equal 

Variances 


2.  Time  to  Identify  the  First  Target 

There  was  a  trend  for  participants  who  completed  the  ACTS  to  have  faster 
identification  times  than  those  who  had  not  completed  ACTS  (f(62)=-1 .986, 
p=0.051)  (see  Table  8). 


Identification  Time 

Participant  Who 
Completed  AGTS 

Participant  Who  Did 
Not  Complete  AGTS 

Mean 

21.529 

34.633 

Standard  Deviation 

17.173 

33.885 

Observations 

34 

30 

Hypothesized  Mean  Difference 

0 

df 

62 

tStat 

-1.986 

P(T<=t)  two-tail 

0.0515 

t  Critical  two-tail 

1.999 

Table  8.  Identification  Time  t-Test;  Two-Sample  Assuming  Equal 

Variances 
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3. 


Time  to  Kill  the  First  Target 


Those  who  completed  ACTS  training  had  a  significantly  lower  target  one 
kill  time  than  those  who  had  not  completed  ACTS  (f(124)=-2.174,  p=0.032)  (see 
Table  9). 


Kill  Time  Target  1 

Participant  Who 
Completed  ACTS 

Participant  Who 
Did  Not  Complete 
ACTS 

Mean 

24.522 

34.237 

Standard  Deviation 

17.230 

31.651 

Observations 

67 

59 

Hypothesized  Mean  Difference 

0 

df 

124 

tStat 

-2.174 

P(T<=t)  two-tail 

0.0316 

t  Critical  two-tail 

1.979 

Table  9.  Time  to  Kill  the  First  Target  t-Test:  Two-Sample 
Assuming  Equal  Variances 


4.  Time  to  Kill  the  Second  Target 

Those  who  completed  ACTS  training  had  a  significantly  lower  target  two 
killing  time  than  those  who  had  not  completed  ACTS  (f(60)=-2.236,  p=0.029) 
(see  Table  10). 


Kill  Time  Target  2 

Participant  Who 
Completed  ACTS 

Participant  Who 
Did  Not  Complete 
ACTS 

Mean 

35.879 

42.621 

Standard  Deviation 

13.059 

10.290 

Observations 

33 

29 

Hypothesized  Mean  Difference 

0 

df 

60 

tStat 

-2.236 

P(T<=t)  two-tail 

0.029 

t  Critical  two-tail 

2.001 

Table  10.  Time  to  Kill  the  Second  Target  t-Test:  Two-Sample 
Assuming  Equal  Variances 
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5. 


Hit  or  Miss  of  a  Target 


There  is  no  statistical  significance  in  hits  or  misses  on  whether  a 
participant  completed  the  training  in  ACTS  or  not  (z=-0.76,  p=0.447).  Those  who 
did  not  complete  the  ACTS  had  a  slightly  higher  proportion  of  hits  than  those  that 
completed  the  training.  The  proportion  of  hits  with  ACTS  is  68.3%  while  the 
proportion  of  hits  without  ACTS  is  73.3%.  Table  11  outlines  the  percentage  of 
misses  that  were  characterized  as  short,  over,  or  lost,  or  simply  as  a  miss. 


Misses 

Participant  Who 
Completed  AGTS 

Participant  Who  Did 
Not  Complete  AGTS 

Short 

(14/32)44% 

(10/24)  42% 

Over 

(17/32)53% 

(9/24)  38% 

Lost 

(1/32)3% 

(4/24)  17% 

Miss 

(0/32)  0% 

(1/24)4% 

Table  1 1 .  Percentage  of  Misses 
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IV.  RECOMMENDATIONS  AND  CONCLUSION 


This  chapter  discusses  the  recommendations  based  upon  the  results  from 
the  main  hypothesis  and  the  exploratory  question.  First,  the  main  hypothesis  and 
the  resulting  lack  of  correlation  for  the  variables  of  interest  are  discussed.  The 
exploratory  question’s  results  and  use  as  a  metric  for  demonstrating  training 
effectiveness  is  highlighted.  Finally  recommendations  for  future  studies  and  work 
are  presented. 

A.  DISCUSSION 

The  analysis  of  the  participants’  performance  during  their  ACTS  exercises 
and  modified  live-fire  gunnery  showed  no  significant  correlation.  This  is  a  similar 
result  to  the  studies  conducted  20  years  ago  found.  We  also  compared  the 
results  of  the  participants  who  had  completed  the  ACTS  training  program  and 
those  that  had  not.  The  participants  who  completed  the  ACTS  training  had  a 
significantly  better  performance  than  those  who  did  not  complete  the  training. 
The  result  of  this  comparison  is  important  as  it  may  provide  a  better  indicator  of 
training  effectiveness  than  correlation. 

1.  Main  Hypothesis 

As  stated  in  Chapter  III,  the  Ho  was  retained.  There  was  no  significant 
correlation  found  between  the  participants’  performance  in  the  ACTS  and  their 
performance  in  the  modified  live  fire  gunnery.  The  lack  of  correlation  between  the 
performance  in  a  simulator  and  performance  in  a  live  setting  may  appear  to 
suggest  that  training  transfer  is  not  occurring,  but  we  believe  correlation  is  the 
wrong  metric  to  assess  training  transfer. 

a.  AGTS  Exercises  and  Modified  Live-Fire  Gunnery 

While  there  was  no  significant  correlation  found,  the  sample  sizes  for 
conducting  the  analysis  were  small.  A  sample  size  of  only  12  could  be  used  for 
the  overall  crew  score  and  time  to  kill  the  first  target.  A  sample  size  of  only  five 
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could  be  used  for  the  time  to  kill  the  second  target.  The  small  sample  size  was 
due  to  a  lack  of  recorded  ACTS  exercise  26081141  that  corresponded  with 
recorded  gunnery  Table  5  performance. 

Participants  had  conducted  nine  exercises  in  the  ACTS  prior  to  executing 
exercise  26081141.  These  exercises  were  used  as  foundational  building  blocks 
to  introduce  the  participants  to  operating  the  tank,  and  firing  the  tank  as  part  of  a 
crew.  The  participants  were  able  to  learn  the  switches,  knobs,  and  buttons 
necessary  to  conduct  an  engagement.  Participants  were  also  introduced  to  target 
identification  and  acquisition. 

The  participants’  first  live  round  fired  from  a  tank  was  their  first 
engagement  on  the  Table  5.  While  they  had  fired  numerous  “rounds”  in  the 
simulator,  the  lack  of  breach  recoil  and  realistic  sound  in  the  simulator  does  not 
adequately  prepare  someone  for  the  experience  of  firing  a  live  round  from  the 
main  gun  of  the  tank.  Additionally,  the  targets  the  participant  saw  in  the  simulator 
are  completely  different  than  what  the  participant  saw  on  the  live  fire  range.  In 
the  simulator,  the  participant  saw  full  silhouettes  of  enemy  vehicles.  On  the  live 
fire  range,  the  targets  are  plywood  painted  dark  green  that  are  either  rectangular 
for  a  PC,  rectangular  with  a  smaller  rectangle  on  top  to  represent  the  front  of  a 
tank,  or  troop  silhouettes. 

Participants  did  have  better  time  to  kill  target  one  and  two  times  on  the 
gunnery  Table  6  than  their  ACTS  exercise  3601 1101.  This  may  be  a  result  of  the 
participant  having  some  familiarity  with  the  range.  If  this  familiarity  with  the  range 
and  the  targets  is  the  factor  for  improved  times,  then  the  question  must  be  asked 
of  how  to  better  transition  an  individual  from  the  simulator  to  the  live  fire. 

The  better  performance  in  ACTS  than  in  the  live  fire  exercises  may  be  a 
result  of  the  crews  progressing  through  numerous  exercises/engagements  prior 
to  executing  the  two  exercises  used  in  this  study.  Since  the  graphics  are  not 
representative  of  what  a  crew  sees  as  a  target  on  the  range,  or  in  real-world 
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operations,  the  crew  has  to  relearn  exactly  what  they  are  looking  at,  which  affects 
all  variables  of  interest. 

2.  Exploratory  Question 

This  study  was  fortunate  to  be  able  to  compare  participants  that  had 
completed  the  ACTS  exercise  36011101  with  those  that  had  not.  The  training 
unit  has  a  policy  that  allows  individuals  to  progress  to  the  live  fire  gunnery  without 
completing  the  GTLF  as  long  as  the  instructor  feels  the  individual  is  safe  enough 
to  execute  the  live  fire.  This  resulted  in  having  34  participants  that  had  completed 
the  GTLF  and  30  that  had  not.  While  the  overall  crew  score  and  identification 
time  only  showed  a  trend  of  those  that  had  completed  the  GTLF  as  having  a 
better  performance,  the  kill  times  of  the  first  and  second  target  were  significantly 
better. 

The  better  performance  of  the  participants  that  completed  GTLF  suggests 
that  training  transfer  may  be  occurring.  While  training  was  constrained  by  time, 
the  ultimate  goal  was  for  each  participant  to  complete  all  exercises  including  the 
GTLF.  This  suggests  that  the  satisfactory  completion  of  all  exercises  is  more 
important  than  just  having  individuals  spending  time  in  the  simulator.  Remedial 
training  must  be  used  for  those  individuals  to  ensure  progression  through  the 
training  exercises. 

B.  RECOMMENDATIONS  AND  CONCLUSION 

This  study  demonstrates  that  simulations  can  have  a  positive  impact  in  the 
training  of  individuals  for  tank  gunnery.  The  critical  component  to  ensure  the 
simulator  is  being  used  to  maximize  the  training  of  crews  is  to  identify  exactly 
what  tasks  the  simulator  can  train.  If  these  tasks  are  identified,  the  simulator 
does  not  become  a  “check  the  block”  requirement,  but  a  critical  enabler  in  the 
training  methodology.  Tasks  that  are  not  trained  in  the  simulator  can  also  be 
addressed  in  the  training  plan  that  commanders  establish  to  prepare  crews  for 
live  fire  gunnery.  This  identification  and  understanding  of  capabilities  not  only 
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allows  commanders  to  maximize  their  training,  but  to  tailor  their  training  to  crew 
specific  training  needs. 

The  better  performance  of  those  who  completed  the  ACTS  compared  to 
those  who  did  not  is  a  case  for  having  the  trailer  equipped  mobile  ACTS  present 
on  the  range  during  the  live  fire  gunnery.  As  crews  progress  through  the  live  fire 
tables,  and  based  upon  their  AARs,  crews  should  be  able  to  use  the  simulator  to 
train  deficient  tasks.  This  method  would  use  the  simulator  as  an  enabler  to 
training  and  not  just  a  “check  the  block”  event. 

Metrics  must  be  established  that  allow  commanders  and  trainers  to 
monitor  a  crews  progress  through  their  training.  A  simulation  based  training 
methodology  that  results  in  individuals  attaining  a  higher  level  of  proficiency  than 
would  be  attained  by  just  live  training  is  the  ultimate  goal. 

1.  Future  Study 

This  study  was  a  relative  small  snapshot  of  armor  training  and  the  use  of 
simulators  to  train  armor  crews.  Additionally,  for  some  variables  of  interest,  the 
sample  sizes  were  small.  Future  studies  that  have  ample  sample  sizes  for  each 
variable  of  interest  could  investigate: 

•  Conducting  an  observational  study  of  a  deployable  active  duty  unit 
for  the  same  variables  of  interest; 

•  What  metrics  explain  how  training  transfer  is  occurring; 

•  Evaluating  the  close  combat  tactical  trainer  capabilities  versus  the 
ACTS; 

•  Task  evaluation  of  a  unit  training  plan  based  upon  those  tasks  that 
are  trained  live  versus  through  simulations; 

•  The  effect  of  realistic  graphics  on  training. 

The  use  of  simulators  to  train  tasks  will  become  more  prevalent  in  the 
military.  Fiscal  constraints  will  limit  the  amount  of  live  training  that  can  be 
conducted.  Decreasing  deployments  mean  more  units  need  to  conduct  home 
station  training  which  decreases  the  amount  of  time  units  have  to  train  on  live 
ranges.  The  use  of  simulations  and  simulators  has  the  potential  to  enable  units  to 
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maximize  live  training  by  training  tasks  in  simulation  to  a  level  of  proficiency  that 
previously  could  only  be  trained  using  live  fire  training. 
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APPENDIX  A.  SURVEY  QUESTIONS 


What  United  States  Military  Service  are  you? 

US  Army  US  Marine  Corps 

Years  of  Military  Service  (to  include  active  and  reserve)? _ 

Prior  Military  Service  (yes  or  no)? _ 

If  yes,  highest  rank  attained _ 

If  yes,  Military  Occupational  Specialty  (MOS) _ 

If  yes,  how  many  years _ 

Current  Age? _ 

Have  you  ever  conducted  tank  gunnery  before? _ 

If  yes,  please  describe  when,  where,  position  on  crew,  and  how  many  gunneries  conducted. 


Please  describe  what  other  training  besides  the  ACTS  (simulator)  that  you  conducted 
before  executing  your  live  fire  gunnery. 


Please  explain  the  benefits  and/or  drawbacks  of  the  other  training  you  described  above. 


How  well  did  the  exercises  in  the  ACTS  prepare  you  for  live  fire  gunnery. 

O  Completely  prepared  me 
O  Somewhat  prepared  me 
(3  Not  sure 

O  Somewhat  prepared  me 
O  Did  not  prepare  me  at  all 
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Please  explain  the  benefits  and/or  drawbacks  of  training  in  the  ACTS  simulator. 

What  tasks  did  you  feel  the  ACTS  best  replicated  compared  to  live  fire  gunnery.  Mark  all 
that  apply. 

O  Use  of  the  fire  control  system  (GCDP)  Q  Issuing  fire  commands 

O  Use  of  the  fire  control  system  (CITV)  O  Use  of  fire  control  system  (CID) 

O  Responding  to  fire  commands  Q  Proper  engagement  techniques 

O  Proper  engagement  procedures  O^arget  acquisition 

Q  Target  identification  O  Laying  the  main  gun  for  direction 

What  tasks  did  you  feel  the  ACTS  did  not  replicate  compared  to  live  fire  gunnery.  Mark  all 
that  apply. 

O  Use  of  the  fire  control  system  (GCDP)  (3  Issuing  fire  commands 

O  Use  of  the  fire  control  system  (CITV)  QUse  of  fire  control  system  (CID) 

(3  Responding  to  fire  commands  techniques 

3  Proper  engagement  procedures  3Target  acquisition 

3  Target  identification  3l-^yl'^9  the  rnain  gun  for  direction 

What  do  you  think  an  effective  armor  gunnery  training  program  should  contain?  Be 
specific. _ 

Any  other  comments  you  would  like  to  make. 
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APPENDIX  B.  IRB  APPROVAL  LETTER 


Naval  Postgraduate  School 
Human  Research  Protection  Program 


From:  Pr«sid*nt,  Naval  Postgraduate  School  (NPS) 

To:  Dr.  Quinn  Kennedy,  Operation  Research  Department  (OR) 

Nr.  Jeff  Appleget,  Operation  Research  Department  (OR) 

Mr.  Perry  McDowell,  Modeling,  Virtual  Environments  and 
Simulation  Institute  (MOVES) 

Mr.  Jesse  Huston,  Modeling,  Virtual  Environments  and 
Simulation  Institute  (MOVES) 

MAJ  Dennis  Wagner,  USA 

Via:  Chairman,  Institutional  Review  Board  (IRB) 

Subj :  TRAINING  EFFECTIVENESS  STUDY  OF  SIMULATOR  USAGE  AND  ITS 
IMPACT  ON  LIVE  FIRE  ARMOR  GUNNERY 

End:  (1)  Approved  IRB  Initial  Review  Protocol 

1.  The  NPS  IRB  is  pleased  to  inform  you  that  the  NPS  President 
has  approved  your  Initial  review  protocol  (NPS  IRBK 

NPS . 2014 . 0031-IR-EP7-A) .  The  approved  IRB  Protocol  is  found  in 
enclosure  (1) .  Completion  of  the  CITI  Research  Ethics  Training 
has  been  confirmed. 

2.  This  approval  expires  on  30  June  2014.  If  additional  time 
i*  required  to  complete  the  research,  a  continuing  review  report 
must  be  approved  by  the  IRB  and  NPS  President  prior  to  the 
expiration  of  approval.  At  expiration  all  research  (subject 
recruitment,  data  collection,  analysis  of  data  containing  PlI) 
must  cease . 

3.  You  are  required  to  obtain  consent  according  to  the 
procedure  provided  in  the  approved  protocol. 

4 .  You  are  required  to  report  to  the  IRB  any  unanticipated 
problems  or  serious  adverse  events  to  the  NPS  IRB  within  24 
hours  of  the  occurrence. 

5.  Any  proposed  changes  in  IRB  approved  research  must  be 
reviewed  and  approved  by  the  NFS  IRB  and  NPS  President  prior  to 
implementation  except  vdiere  necessary  to  eliminate  apparent 
immediate  hazards  to  research  participants  and  subjects. 

6.  As  the  Principal  Investigator  (PI)  it  is  your  responsibility 
to  ensure  that  the  research  and  the  actions  of  all  project 
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Subj :  TRAINING  EFFECTIVENESS  STUDY  OF  SIMULATOR  USAGE  AND  ITS 
IMPACT  ON  LIVE  FIRE  ARMOR  GUNNERY 

personnel  involved  In  conducting  this  study  will  conform  with 
the  IRB  approved  protocol  and  IRB  requlrements/policies . 

7.  At  completion  of  the  research,  no  later  than  expiration  of 
approval,  the  PI  will  close  the  protocol  by  submitting  an  End  of 
Ebcperiment  Report. 


'essence  G.^Shattuck,  PhD 

Chair 

Institutional  Review  Board 


Ronald  A.  Route 

Vice  Admiral,  U.S.  Navy  <Ret.) 

President,  Naval  Postgraduate  School 


Date: 


fEB  2  6  2014 
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APPENDIX  C.  CONSENT  FORM 


Naval  Postgraduate  School 
Consent  to  Participate  in  Research 

Introduction.  You  are  invited  to  participate  in  a  research  study  entitled  Training 
Effectiveness  Study  of  Simulator  Usage  and  its  Impact  on  Live  Fire  Armor  Gunnery.  The 
purpose  of  the  research  is  to  determine  if  there  is  a  correlation  between  the  crew  score 
during  the  Gate  to  Live  Fire  (GTLF)  exercise  utilizing  the  Advanced  Gunnery  Training 
System  (AGTS)  and  Table  VI  live  fire  gunnery  qualification. 

Procedures.  This  study  will  collect  data  on  the  tank  commander  and  gunners  as  a  team 
and  their  results  in  the  AGTS  and  during  the  Table  VI  live  fire  gunnery  qualification.  A 
survey  will  be  given  to  all  participants  at  the  end  of  their  live  fire  gunnery  portion  of  the 
study  to  gain  a  subjective  understanding  of  the  individual’s  experience. 

A  brief  will  be  given  of  an  overview  of  the  study  and  participant  involvement. 
Following  the  brief,  all  volunteers  will  fill  out  a  standard  consent  form,  providing  either 
consent  to  all  of  the  study.  After  the  consent  form  is  filled  out,  participants  will  be  logged 
into  the  subject  log  and  receive  your  subject  ID  number.  Data  from  the  experiment  will  only 
be  referenced  using  the  subject  ID  number.  All  data  in  the  final  report  will  be  reported  in 
aggregate. 

Participants  will  execute  the  AGTS  portion  of  the  study  based  upon  the  current 
program  of  instruction  for  the  Armor  Officer  Basic  Leader  Course.  The  duration  of  this 
portion  of  the  study  is  based  upon  the  unit’s  current  training  schedule  and  will  not  be 
modified  for  the  purposes  of  this  study.  The  Advanced  Gunnery  T raining  System  data 
collected  will  be  the  results  of  the  crew  the  computer  captures  and  prints  as  part  of  the 
feedback  capability  to  include  the  computer  generated  crew  gunnery  score  sheet. 

Participants  will  execute  the  live  fire  gunnery  portions  of  the  study  based  upon  the 
current  program  of  instruction  for  the  Armor  Officer  Basic  Leader  Course.  The  duration  of 
this  portion  of  the  study  is  based  upon  the  unit’s  current  training  schedule  and  will  not  be 
modified  for  the  purposes  of  this  study.  During  the  Table  VI  live  fire  gunnery  qualification, 
the  crew’s  scores  will  be  collected  once  the  firing  scenarios  are  completed  and  the  Tank 
Crew  Evaluator  and  Master  Gunner  verify  the  crew  gunnery  score  sheet. 

A  survey  will  be  given  to  all  participants  at  the  conclusion  of  the  live  fire  gunnery 
portion  of  the  study.  This  survey  should  take  approximately  20  minutes  and  will  provide  a 
better  understanding  to  the  data  collected.  If  additional  clarification  is  required,  you  may  be 
contacted  by  the  researcher  by  email. 

The  population  that  is  asked  to  participate  in  this  study  is  the  current  Armor  Cfficer 
Basic  Leader  Course  in  training.  Actual  participation  is  voluntary. 

Data  will  be  reported  in  aggregate;  though  specific  results  may  be  referenced  in 
academic  publications  with  no  reference  to  you,  unless  consent  is  provided  by  the  subject. 
Your  individual  results  will  not  be  released  to  any  entity  or  agency. 

There  will  be  no  audio  or  video  recording  used  in  this  study. 

There  is  no  cost  to  participate  in  this  research  study. 
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Location.  The  interview/survey/experiment  will  take  place  at  Fort  Benning  Georgia  at 
varying  training  venues  based  upon  the  training  scheduled  published  by  chain  of 
command. 

Voluntary  Nature  of  the  Study.  Your  participation  in  this  study  is  strictly  voluntary.  If  you 
choose  to  participate  you  can  change  your  mind  at  any  time  and  withdraw  from  the  study. 
You  will  not  be  penalized  in  any  way  or  lose  any  benefits  to  which  you  would  otherwise  be 
entitled  if  you  choose  not  to  participate  in  this  study  or  to  withdraw.  The  alternative  to 
participating  in  the  research  is  to  not  participate  in  the  research. 

Potential  Risks  and  Discomforts.  It  is  anticipated  that  there  will  be  no  to  minimal  risk 
or  discomfort  that  will  be  present  during  this  study.  This  study  is  observing  current 
training  that  has  been  approved  by  the  Maneuver  Center  of  Excellence.  There  will  be  no 
change  to  the  current  training,  and  as  such,  participants  are  executing  tasks  they  are 
required  to  in  the  execution  of  their  training  regardless  of  participation  in  the  study.  The 
only  change  to  the  training  will  be  the  addition  of  the  survey  at  the  end.  This  survey  will 
be  strictly  anonymous,  and  only  aggregate  data  may  be  provided  to  the  unit. 

Anticipated  Benefits.  Anticipated  benefits  from  this  study  are  in  relation  to  better 
determining  where,  who,  and  how  much  simulator  training  is  required  for  equal  or  better 
execution  in  the  live  gunnery  environment.  Through  collected  data  of  both  simulator 
training  and  live  fire  gunnery  and  the  statistical  analysis  of  this  data,  it  will  be 
determined  if  units  can  use  the  data  provided  through  training  venues  to  target 
critical  tasks  and  specific  crews  to  improve  the  overall  qualification  score. 

Compensation  for  Participation.  No  tangible  compensation  will  be  given. 

Confidentiality  &  Privacy  Act.  Any  information  that  is  obtained  during  this  study  will  be 
kept  confidential  to  the  full  extent  permitted  by  law.  All  efforts,  within  reason,  will  be 
made  to  keep  your  personal  information  in  your  research  record  confidential  but  total 
confidentiality  cannot  be  guaranteed.  Each  subject’s  name  and  contact  information  will 
be  captured  on  a  spreadsheet  and  a  study  identification  number  will  be  assigned.  This 
document  will  be  stored  separately  from  all  data.  All  data  in  the  study  will  be  recorded 
electronically,  using  the  study  identification  number.  Once  the  study  is  complete,  the 
hard  copy  of  the  subject’s  contact  information  and  study  identification  number  will  be 
destroyed.  No  information  from  this  study  will  be  reported  to  the  subject’s  chain  of 
command.  All  other  data  will  be  stored  electronically  on  access  controlled  computers  at 
the  Naval  Postgraduate  School.  Any  information  that  is  obtained  during  this  study  will  be 
kept  confidential  to  the  full  extent  permitted  by  law.  If  you  consent  to  be  identified  by 
name  in  this  study,  any  reference  to  or  quote  by  you  will  be  published  in  the  final 
research  finding  only  after  your  review  and  approval.  If  you  do  not  agree,  then  you  will 
be  identified  broadly  by  discipline  and/or  rank,  (for  example,  “fire  chief). 

O  I  consent  to  be  identified  by  name  in  this  research  study. 

□  I  do  not  consent  to  be  identified  by  name  in  this  research  study. 

Points  of  Contact.  If  you  have  any  questions  or  comments  about  the  research,  or  you 
experience  an  injury  or  have  questions  about  any  discomforts  that  you  experience  while 
taking  part  in  this  study  please  contact  the  Principal  Investigator,  Dr.  Quinn  Kennedy  656- 
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2618,  mqkenned@nps.edu.  Questions  about  your  rights  as  a  research  subject  or  any  other 
concerns  may  be  addressed  to  the  Navy  Postgraduate  School  IRB  Chair,  Dr.  Larry 
Shattuck,  831-656-2473,  lgshattu@nps.edu. 

Statement  of  Consent.  I  have  read  the  information  provided  above.  I  have  been  given 
the  opportunity  to  ask  questions  and  all  the  questions  have  been  answered  to  my 
satisfaction.  I  have  been  provided  a  copy  of  this  form  for  my  records  and  I  agree  to 
participate  in  this  study.  I  understand  that  by  agreeing  to  participate  in  this  research  and 
signing  this  form,  I  do  not  waive  any  of  my  legal  rights. 


Participant’s  Signature 


Date 


Researcher’s  Signature 


Date 
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